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Hexagonal  vs. 
Rectangular 


Hexagonal  Grid 


•  Optimal  representation 

•  Consistent  connectivity 

•  Angular  resolution  is  60  degrees 

•  Equidistant  Spacing 

•  6-fold  symmetry 

•  Mimics  nature _ 


Rectangular  Grid 


•  Non-optimal  representation 

•  Connectivity  ambiguity:  4-way  vs.  8-way 

•  Angular  resolution  is  90  degrees 

•  Unequal  spacing 

•  4-fold  symmetry 

•  Man-made 
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Natural  Systems 


Compound  eye  of  the  blowfly  {Calliphora 
Vomitoria) 


Reproduced  from  httD://www.bath.ac.uk/ceos/lnsects1.html 
©  University  of  Bath 


Distribution  of  cones  in  the  fovea  of  a 
human  retina  showing  high  peak 
density  (A)  and  low  peak  density  (B) 
(bar  is  10  microns). 


Reprinted  from  Curcio  et  al.  (1987) 
©AAAS 
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Why  is  Hex  Optimal? 


^gray  _  vB 


A 


green 


The  spatial  sampling  geometry 
determines  the  spectral  tiling,  and 
the  derst^f^^^^pplj^^pl 
deteOh^bi^SlaUDO^ile 


nd  4  =  4 

It  pi#id^the' 


efficient  packing  of  circles  in 


the  frequency  domain. 


M  ■ 
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Addressing  Schemes 


Spiral  Addressing 
(GBT,  HIP,  etc.) 
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Array  Set  Addressing 

(ASA) 


X 


•  ASA  separates  the  hexagonal  grid  into  two  rectangular  arrays 

•  A  three  coordinate  system  addresses  the  individual  points  on 
the  grid  -  a  binary  array  coordinate  followed  by  the  familiar 
row  and  column  coordinates:  (a,r,c)  e  {0,1}  X  Z  X  Z 

AFRl!^i 
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Hexagonal  Neighbors 


For  any  pixel  (a,r,c),  it’s  neighbors  are: 


(  a,  r,  c-1  ) 


{a,  r,c) 


(  a,  r,  c+1  ) 


•  Finding  a  neighbor's  address  is  an  0((logN)^) 
operation  using  spiral  addressing 

•  No  connectedness  ambiguity  -  a  neighbor  is 
a  neighbor 
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Distance  Measures 


Converting  ASA  to  Cartesian  is  a 

y2.  0  ^ 

3/2  Vs  0 


X 

_y_ 

simple  matrix  multiplication: 

(a/2  +  c) 

(V3)(a/2  +  /-)_ 


r 

c 


Euclidean  distance  (on  the  image  plane)  between  two  points 
Pi  =  (ai,ri,Ci)  and  P2  =  (a2,r2,C2): 


Q^(Pi>P2)  = 


“City-Block”  distance  (on  the  image  plane)  between  two  points 
p,  =  (a,,r,,c,)  and  pg  =  (a2,r2,C2): 

^^  =  (<^1-^2)- 

y  =  {a,-a^) 

-(^1-^2) 

+  (2)(ri-r2) 

|f/|  +  |y  1  if  U  and  V  have  the  same  sign 

de(Vi,V2)  =  ^ 

max(|t/|,|y|)  otherwise 
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Vector  Operations 


Let  p, 


r. 


v^/y 


gASA 


.iT'i 
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ASA  is  a  Z-Module 


ASA  satisfies  the  8  properties  of  a  Z-module: 


Property 

Significance 

Comnnutativity  of  addition 

Pi  +  P2  =  P2  +  Pi 

Associativity  of  addition 

Pl  +  (P2  +  P3)=  (Pl  +  P2)  +  P3 

Identity  element  of  addition 

30  e  ASA:  p  +  0  =  p,  Vp  e  ASA 

Inverse  elements  of  addition 

3q  e  ASA:  p  +  q  =  0,  Vp  e  ASA 

Distributivity  of  scalar  multiplication 
(wrt  vector  addition) 

k(p  +  q)  =  kp  +  kq 

Distributivity  of  scalar  multiplication 
(wrt  scalar  addition) 

(k  +  j)p  =  kp  +  jp 

Compatibility  of  scalar  multiplication 
(with  multiplication  of  scalars) 

l<(  jp)  =  (l<j)P 

Identity  element  of  scalar  multiplication 

lp  =  p 
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Gradient  Estimation 


z  =  ax+by+c 


X  direction  (0°)  y  direction  (90°) 


120 


90‘ 


150 


210 


By  symmetry,  we  can  estimate 
gradients  along  6  axes 


>  12 
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Performing  Convolutions 


Array  1 


Array  0 


Array  1 


-1 

1 

-1 

1 

Convolution  Mask 


-1 

1 

-1 

1 

Array  1 
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Convolution  Complexity 


Assumptions: 

—  Hexagonal  and  rectangular  images  are  each  M  x  N  pixels 

—  Image  borders  are  padded  to  allow  each  pixel  to  use  the  full  convolution  mask 

—  Let  Cjj  be  the  convolution  of  the  i-array  of  the  image  with  the  j-array  of  the  convolution 


mask 


Hexagonal  Neighborhood 
of  1®^  Nearest  Neighbors 
(7  point  mask) 


ASA  convolution  (7  point  mask): 

step 

Multiplications 

Additions 

Calculate  Cqo 

(3)(M/2)(N) 

(2)(M/2)(N) 

Calculate  Cgi 

(4)(M/2)(N) 

(3)(M/2)(N) 

Calculate  C^g 

(3)(M/2)(N) 

(2)(M/2)(N) 

Calculate  C^^ 

(4)(M/2)(N) 

(3)(M/2)(N) 

Sum  of  Cqo  and  C^^ 

0 

(M/2)(N) 

Sum  of  Cqi  and  C^g 

0 

(M/2)(N) 

TOTALS: 

7MN 

6MN 

Rectangular  Neighborhood 
of  1®^  Nearest  Neighbors 
(9  point  mask) 


[Rectangular  convolution  (9  point  mask): 

Multiplications 

Additions 

TOTALS: 

9MN 

8MN 
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Canny  Edge  Detector 


Hexagonally  sampled 


Rectangularly  sampled 
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Angular  Resolution 


^  0  degrees 
^  45  degrees 
^  90  degrees 
^  135  degrees 


degrees 
1 30  degrees 
^60  degrees 
1 90  degrees 
1 120  degrees 
1 50  degrees 


The  increased  angular  resolution  of  the 
hexagonal  grid  may  account  for  the  increased 
performance  of  the  Canny  edge  detector. 
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Downsampling 


Anti-aliasing  Mask 


We  want  to  use  >2  of  each  of  the  neighboring 
pixels  since  they  are  shared  with  adjacent 
"superpixels"  So  we  are  averaging  together 
(6)(l/2)  +  1  =  4  pixels,  resulting  in  the  above 
averaging  mask. 


After  convolving  the  image  with  the  averaging  mask,  the  light  blue 
pixels  form  the  downsampled  0-array  and  the  dark  blue  pixels  form 
the  downsampled  1-array.  The  resulting  arrays  are  1/4  the  size  of  the 
original  arrays  (i.e.  (N/2)  X  N  =>  (N/4)  x  (N/2)). 
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Wavelet  HPF  Advantage 


HPF  3 

HPF  2 

HPF  3 

HPF  1 

LPF 

HPF  1 

HPF  3 

HPF  2 

HPF  3 

Rectangularly  Sampled 


Idealized  Frequency  Domain  Regions  of  Support 


f  18 
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Perfect  Reconstruction 
(PR)  Example 


ASA  implementation  of  Allen  PR  wavelet,  runtime  =  0.5017  (0.0077)  sec 


Rect.  implementation  of  CDF  9/7  wavelet,  runtime  =  0.5484  (0.008)  sec 

AFRli^*  ,9 
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HDFT/HFFT 


Mersereau’s  HDFT: 


X(l<vl<2}  =  'Z'Zx{n„n^}e>(p 


A7i  A72 


JTT 


v2W, 


(n^k, ) 


x{a,n,)  = 


N,(2N,  +  N,)X% 


XX^('fi>^2)exp 


JTT 


( 


\2k^-^  ^  [n^k^ ) 


Mersereau  encountered  an  “insurmountable  difficulty” 
when  attempting  to  develop  a  fast  algorithm  to  compute 
the  hexagonal  DFT,  due  to  the  product  of  mixed 
coordinates  in  the  exponential. 


P  20 
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HDFT/HFFT(Cont.) 


The  HDFT  in  ASA  becomes: 

X(5,s,d)  =  ^^2]x(a,r,c)exp 

arc 

x(a,r,c)=  ^^^X(fc>,s,d)exp 

^rnn  t  s  d 

[2m 

2m  ^  0^  ^  n 

Column  Coordinates 

Row  Coordinates 

X{Hs,d).YI, 


a  r 


^x(a,r,c)exp  -^{a  +  2c\b+2dfj  exp  -^{a  +  2r\b+2s) 


x(a,r,c)  =  ^X(ib,s,c/)exp  -^{a  +  2cXb+2d)]  exp  ^{a  +  2r\b+2s) 

2.nnn  b  s  d  v^at?  J 


f  ^ 

V  n 


The  Fourier  kernel  is  separable  in  ASA  space! 
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Fourier  Transform  of 
Allen's  Filter  Bank 


Low-Ptiss  fiLter 
-14 


-84  -14 


-14  +276  +259 

-S4  +259  +759  +276 

-14  +276  +259 

-S4  -14 

-14 


High-Pass  filter 
+50 

+SD0  +50 

—  2  +S4  —925 

-12  +37  +231  +84 

-2  +84  +37 

-12  -2 


-2 


The  values  given  ace  exaci.  (Tliey  mus)  be  divided  by  1014  to  actrieve 
normalization.)  The  other  two  filtei's  can  be  visnaLized  by  rotating  the 
Higji-pass  filter  120'^  and  240'^. 


J.  D.  Allen,  “Perfect  reconstruction  filter  banks  for  the  hexagonal  grid,”  in  Proc. 

5th  Int.  Conf.  Information,  Communications,  and  Signal  Processing,  Dec.  2005,  pp. 
73-76. 


i 
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ASA  vs.  HIP 


Operation 

HIP 

ASA 

Ratio 

Address  (Vector)  Addition 

23.85  (3.15) 

2.11  (0.97) 

11.28 

Address  (Vector)  Subtraction 

33.98  (3.56) 

2.56  (0.47) 

13.28 

Scalar  Multiplication 

6652.08  (4076.89) 

3.73  (0.73) 

1782.20 

Calculate  Euclidean  Distance 

15.83  (2.43) 

2.73  (0.56) 

5.79 

Calculate  6  Nearest  Neighbor  Addresses 

118.94  (10.49) 

3.31  (0.75) 

35.89 

Convert  From  Cartesian 

9189.68  (3784.79) 

4.48  (1.13) 

2052.31 

Each  result  is  the  mean  of  10,000  operations  on  randomly  selected  addresses  (ps,  mean  (std)) 


Operation 

HIP 

ASA 

Address  (Vector)  Addition  /  Subtraction 

0((logN)2) 

0(1) 

Scalar  Multiplication 

0(N(logN)2) 

0(1) 

Calculate  Euclidean  Distance 

O(logN) 

0(1) 

Calculate  6  Nearest  Neighbor  Addresses 

0((logN)2) 

0(1) 

Convert  From  Cartesian 

0(N(logN)2) 

0(1) 
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Hex-Rect  Imager 


1^' 
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Experiment  Results 


Spatial 


Rectangularly  Sampled 


Hexagonal  ly  Sampled 


Fourier 


Rectangularly  Sampled 


Hexagonal  ly  Sampled 


0.268/0.309  »  0.867  «  (V3)/2  «  0.866 
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Conclusion 


•  There  are  several  advantages  to  sampling  digital 
images  hexagonally  rather  than  rectangularly 

•  ASA  is  tri-coordinate  system  for  addressing  a 
hexagonal  grid  that  provides  support  for  efficient 
image  processing 

•  Efficient  ASA  methods  were  shown  for  gradient 
estimation,  convolution,  downsampling,  wavelet 
decomposition,  and  hexagonal  DFT 

•  The  Hex-Rect  imager  can  be  used  to  quantitatively 
compare  hexagonal  and  rectangular  sampling 

AFRI^*  26 
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Questions? 
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Backup  Slides  Follow 
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On-FPA  Processing  with 
Difference  of  Gaussians 


Input  Signal 
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Neuromorphic  Infrared 
Sensor  (NIFS) 


l^i 
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Hexagonal  Imagers 


Carver  Mead's  Silicon  Retina 
Hauschild's  Prototype 
Gaber's  Design 
Centeye's  Hex-Rect 
More  to  come... 
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Hex-Rect  Unit  Cells 


To  adjacent 
pixel 
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Examples 
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Hex-Rect  Specs 


Drawn  chip  size 

G.lmm  X  ll.lnim 

Fbcal  plane  size 

4.7mni  x  9.2nim 

Fbcal  plane  resolution 

Raw  trapezoid  pixels:  304  x  512 

Hexagonal  array:  152  x  255  (even  roivs  have  256  hex  pixels) 
Rectangular  array:  151  x  256 

Pixel  type 

3- transistor  active  pixel,  with  support  for  both  logarithmic  response 
and  linear  response 

Pixel  pitch 

18  microns  wide  by  15.6  microns  high  for  raw  pixels 

Post-pixel  circuitry 

8-bit  flash  ADC 

Interface 

PI012B  parallel  interface: 

8  bidirectional  digital,  2  digital  in,  1  analog  out 

12- bit  command  bus  in  tw^o  6- bit  words 

8- bit  digital  out 

Optional  3  input  chip  select 

Optional  analog  out 

Alternative  12  bit  input  /  8  bit  output  parallel  interface 

Process 

ON- Semi  C5N  3  metal  2  poly  0.5  micron  process 

Chip  operating  voltage 

4V  to  5V  preferred 

Digital  input  0/1  threshold 

About  0.95V 

Voltage  regulation 

On-chip  voltage  regulator  for  analog  circuits  and  bias  generators 

1^ 
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Hex-Rect  Interface 
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IR  Readout 
Considerations 


coluiiui  address 


row  address 


coliiimi  select 


■ 


I  second  siibarra^^ 


buffered  out2 


From  R.  Hauschild  etal.,  “A  CMOS  Optical 
Sensor  System  Performing  Image  Sampling 
on  a  Hexagonal  Grid”  in  Proc.  22"^  European 
Solid-State  Circuits  Conf.,  304-307,  1996. 


Typical  readouts  (ROICs)  are 
designed  to  read  out 
rectangular  arrays 

Slight  modifications  should 
allow  hexagonally  sampled 
images  to  be  read  out  into  the 
ASA  data  structure 

Images  from  the  prototype  on 
the  right  could  have  been 
processed  directly  using  ASA 
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IR  Detector  Materials  and 
Bump  Bonding  Considerations 


•  Indium  Gallium  Arsenide  (InGaAs) 

-  NIR  (0.4  - 1.6  um),  Uncooled  or  slightly  cooled 

•  Indium  Antimonide  (InSb) 

-  MWIR  (3-5  urn),  Cooled  to  77K 

•  Mercury  Cadmium  Telluride  (HgCdTe) 

-  MWIR  (3-5  urn),  Cooled  to  77K  or  120K+ 

-  LWIR  (8-12  urn).  Cooled  to  77K  or  120K+ 

•  QWIP 

•  Strained  Layer  Superlattice 
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30  pixels  +  12  half¬ 
pixels  =  36  pixels 


Total  Area  :  (36 


18^/3 


36  pixels 


Total  Area  :  (36 


18^/3 


l^l 
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Image  Formation  Results 


Original  Image  Hexagonally  Sampled  Rectangularly  Sampled 


f  39 
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Pixel  Geometries 


“Pixel  Geometries”,  P.  Halasz 
Reproduced  from: 

http://commons.wikimedia.0rg/wiki/File:Pixel_geometry_OI_Pengo.jpg 


4 

4 


Hexagonal  RGB  ggsigrp^^ 
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ASA  Storage 


Use  memory  addresses  as  indices: 

Assume  an  N  x  2j  ASA  image  and  a  32  bit 
address  space 
Column  index  =  j 

Row  index  =  ceil(log2(N/2))  bits  =  m 

Array  index  =  1  bit 

Base  address  =  32-(j+m+l) 


For  example,  a  443x512  format  provides  a 
4:3  aspect  ratio  (in  Cartesian  space)  and  the 
address  format  is 

XXXXXXXXXXXXXXRRRRRRRRACCCCCCCC 

' — ^ ‘  ‘ - ^ - * 

Base  Row  Array  Column 

Yields  row-major  order  storage 
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Converting  ASA  to 
Cartesian 


For  a  regular  hexagonal  grid  described  by 


X 

~d  d/2  ■ 

n, 

y_ 

_0  d^I3/2_ 

^2 

where  x  and  y  are  Cartesian  coordinates,  n^  and  n2  are  integers  (oblique 
coordinates),  the  conversion  from  ASA  to  Cartesian  coordinates  is  a  simple 
matrix  multiplication: 


X 

d/2  0  d 

a 

»* 

■  (dXa/2+c)  ■ 

y_ 

_dV3/2  dVs  0_ 

/ 

c 

_(d^\a/2  +  r)_ 

The  parameter  d  is  the  distance  between  any  two  adjacent  grid  points. 
Assume  that  d=1  for  the  remainder  of  the  presentation. 
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Converting  Cartesian  to 

ASA 


Convert  the  Cartesian  coordinates  (x,y)  into  integers  (x^,y^)  by  first  scaling 
each  dimension,  then  rounding  to  the  nearest  integer: 

X.  =  2x  ^  round(x3) 


ys=^  y,  =round(yJ 


0 
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w 


Converting  Cartesian  to 
ASA  (Cont.) 


y  -  (yr-1/3)  =  (-1/3)(X-Xr) 


Determine  which  quadrant  (Xs,ys)  is  in  by  comparing  to  (Xpy^) 

Using  the  known  point  and  slope  determine  if  (x^,ys)  's  above  or  below  the  line 
Adjust  (Xpy^)  to  correct  hexagon  center 
Convert  (Xpy^)  to  ASA  using: 

a  =  y,  mod2 


r  = 


Yr-^ 


x-a 

c  =  — — 


i^i 
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Downsampling  Example 
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Sampling  Densities 
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Hex  Characteristics 


The  spacing  is  important  to  maintaining  the 
natural  symmetry  of  the  hexagonal  grid. 


l^i 
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